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Abstract 


STEM is an approach that seemly considered helpful in online learning because it can facilitate students 
to learn about 21st-century skills. This study aimed to develop module-based STEM in improving 
scientific literacy skills in distance learning through e-learning. Because this research developed 
module-based STEM, this study was named developmental research. The research procedure follows 
the stages of the R & D method developed by Barg and Gall, including preliminary, product planning, 
development, validation (validation by experts), revision, and field testing. Modules that have been 
declared valid by experts are field-tested using one group pretest-posttest design in an experimental 
class. The results show that the feasibility of module-based STEM in the distance learning model to 
increase students' skills within scientific literacy was valid with an average score of 4.28 by two experts. 
In addition, the application of integrated STEM teaching materials through e-learning has a moderate 
effect on students' scientific literacy skills since the N-gain score was 0.6. 
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INTRODUCTION 

The 21st century is the era where technological development is very rapid and 
caused a significant impact, especially on the changes in the education sector. 
Therefore, Rahayu (2017) stated that 21st-century skills are necessary to ensure the 
students be able to overcome the 21st-century’s challenges, it consists of the literacy 
of digital-age, creative thinking, communication effectiveness and high productivity. 
The skills of digital-age literacy are in line with NCREL, and it comprises basic, 
scientific, economic, technological, visual, information, and multicultural literacy (van 
Laar et al., 2017). 

Scientific literacy is one of the crucial competencies to increase knowledge and 
problem-solving skills (Nurtanto et al., 2018). Scientific literacy is directly connected 
with the scientific understanding concepts and processes required for personal 
decision-making, civic and cultural affairs participation, and economic productivity 
(Rusilowati et al., 2016). Scientific literacy needs to be delivered to the current 
generation because it can direct them to have strong scientific thoughts and attitudes 
and effective communication to the general public (Dewi et al., 2019). In PISA 
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(Program for International Students Assessment), scientific literacy means three 
competencies: students can recognize the science issues (problems), phenomena 
scientifically explanation, and apply scientific evidence. 

The government has carried out various policies in order to improve students' 
skills of scientific literacy in Indonesia, including the change of the curriculum from 
the KTSP to the 2013 curriculum until the High Order Thinking Skills (HOTS) 
questions type application in the National Examination. However, the results are not 
very encouraging because, according to the outcomes of the PISA finding in 2018, the 
low scores of Indonesian students' skills in scientific literacy are still founded. Mostly, 
Indonesian student's score in scientific literacy is still below the determined score of 
489, the Indonesian student's score is about 396. In science assessment, Indonesia is in 
the ninth rank from the bottom compared to the other OECD countries (OECD, 2019). 

This prompted the government to make a new policy in the form of eliminating 
the National Examination and changing it to the Minimum Competency Assessment 
or called AKM (Asesmen Kompetensi Minimum) starting in 2021. As stated by the 
Minister of Education and Culture Nadiem Makarim, quoted from kompas.com in 
2019, the AKM is an assessment that measures the minimum skills needed by students 
to be able to learn and is a form of simplification of the National Examination, which 
is so complex. The material consists of only three, namely literacy, numeracy, and 
strengthening character education (Muliani et al., 2021). The literacy and numeracy 
material in the AKM questions refers to PISA. 

Given that the AKM questions measure students' scientific literacy, the teacher 
should practice scientific literacy skills in science learning so that students are ready 
to face AKM. However, currently, the world is being hit by the Covid-19 (Coronavirus 
Disease 2019) pandemic, because of it, many sectors are impacted in Indonesia, with 
no exception for the educational sector. During this pandemic, the Minister of 
Education and Culture issued circular number 36962 / MPK.A / HK / 2020, which 
obliged all learning to be carried out online. However, some students considered 
online learning boring (Oliveira et al., 2018) and only focused on understanding the 
students' concepts (Picciano, 2017). Teachers rarely practice scientific literacy skills for 
students. 

The optical instruments topic is one of the materials accommodated within 
physics learning in high school on basic competencies 3.11 Examining the optical 
instruments working by applying the light reflection and refraction properties 
through mirrors and lenses and 4.11 Creating works which use the reflection principle 
or a refraction towards mirrors and lenses. The concepts of optical instruments are 
closely related to everyday life. Still, various educational research shows the difficulty 
and obscurity of the light topic and optical instrument (Galili & Hazan, 2000). The 
concept is complex and difficult, leading to the student’s misconceptions (Ling, 2017). 
In addition, based on the basic competencies in the 2013 curriculum, students are 
expected to understand concepts and work on making a simple optical device. 
However, most teachers only focus on the cognitive realm (Anindya & Wusqo, 2020), 
so basic competence in skills is rarely achieved. 

Referring to the solution of problems about online learning that do not train 
scientific literacy skills and lack of student skills in making an optical instrument 
product, something is needed that can make students active in learning and practice 
scientific literacy skills, namely by Module-based STEM. The STEM integrated 
teaching materials application can increase the competencies of scientific literacy 
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(Widayoko et al., 2018). STEM learning is seen as an approach capable of providing 
significant changes in the 21st century (Widya et al., 2019). Scientific literacy skills, 
which are part of the 21st-century skills, by using STEM-based science learning, it 
could be achieved (Afriana et al., 2016; Ismail et al., 2016; Wahyu et al., 2020; Lestari 
et al., 2021). HACIOGLU et al., (2016) stated that to increase the interest of the 
Indonesian young generation in technology, engineering, science, and mathematics, 
learning in schools must be carried out according to educational patterns that include 
STEM aspects, namely technology, engineering, science, and mathematics. In the 
development of the 21st century, appropriate learning is learning with the STEM 
approach, where STEM integrates technology, engineering, science, and mathematics 
in learning that is carried out (Widarti et al., 2020). Meanwhile, Kelley and Knowles 
(2016) define STEM as an approach that can train STEM science two or more fields, 
namely technology, engineering, science, and mathematics. Through this approach, 
the learning process discuss not only science but also its practice in real life. 

In order to help students learn optical instruments more easily with the STEM 
approach, a module is needed. The module itself is a teaching material that trains 
students' independence in learning (Risdianto et al., 2020) Arifa. Several previous 
researchers stated that the module integrated with the STEM approach supported the 
achievement of scientific literacy skills (Prasetyo et al., 2021). One of the themes of the 
module integrated STEM that has been studied is Microscope Smartphone by 
measuring students' understanding of concepts (Dewati et al., 2019). In this study, the 
module was developed on the theme of the Smartphone Projector from Cardboard to 
train students' scientific literacy. Therefore, the purpose of the study is to describe the 
Module-based STEM and explain the effect of Module-based STEM that is 
implemented in e-learning on students' scientific literacy skills. 


METHOD 


Research Design and Procedures 

This research is a research development because Borg and Gall developed the 
Module-based development with the R and D (Research and Development) method 
(Buchori & Setyawati, 2015). here was two main objectives of development research, 
namely, product development and the product effectiveness tested in order to achieve 
the goals. This study's research and development procedures include the studies of 
preliminary, design, development, validation, revision of the product, field testing, 
and final products. Preliminary studies are used by researchers to analyze needs, 
review literature, and identify factors that cause problems so that there is a need to 
develop Modul-based STEM. Furthermore, the researchers began to determine the 
design of Module-based STEM including designs, components, materials, drawings 
that are discussed with other research members. Product development is the stage of 
making Module integrated STEM and also scientific literacy tests. Two experts then 
validated the modules and scientific literacy tests that were compiled. 

The final product produced was then subjected to field trials through e-learning 
involving 30 students of class XI-D IPA for the 2020/2021 academic year to determine 
the effect of Module-based STEM on students' scientific literacy. The research design 
when trying out the module in the classroom is described as follows. 





Experiment class O1 X O2 
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In this study, the students' scientific literacy skills were measured at the field 
testing stage 2 times, namely before and after the implementation of the Module-based 
STEM. 


Instruments 


This study used a scientific literacy test as the instrument that was prepared 
based on three scientific literacy indicators, consisting of scientific reasoning and 
inquiry, problem solving, and the basic competencies of optical instrument material. 
The grid of scientific literacy skills instruments shows in Table 1. Before the scientific 
literacy test instrument was used in this research, the validation of the instrument was 
done by two experts. 

Table 1. Science Literacy Test Grid 


Indicator of Scientific Item 
nears; Learning Objectives 





Literacy Number 





Scientific Inquiry 1. Determining the experiment variables 3,4,5 
2. Making Conclusion 


Scientific Reasoning 3. Giving reason scientifically of phenomena about  6,8,9 
optical instruments 
Problem Solving 4. Giving the alternative solution of daily problems = 1,2,7 


about optical instruments 





Data Analysis 

The criterion that is written in Table 2 is the criteria used to analyze the validation 
results of the module and scientific literacy test (instruments). Besides providing the 
grades, the experts also offer comments for module improvements. 
Table 2. Criteria of Validation Results 








Score Interval Category 
Va=5 Very Good/ Valid 
4<Va<5 Good/ Valid 
3<Va<4 Adequate/ Valid 
2<Va<3 Poor/Not Valid 
1<Va<2 Very Poor/Not Valid 





In determining the Module-based STEM effect on scientific literacy skills, an N- 
gain score analysis was carried out. 
_ S post —S pre 
( ) ~ §Smax—S pre 
The results of normalized gain calculations are categorized according to 
classification (Hake, 1999). 
Table 2. N-Gain Criteria 








Gain Score Category 
>0.7 High 

0,7>¢>0,3 Medium 
<0,3 Low 
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RESULTS AND DISCUSSION 

The following descriptions are the gained results and discussions of this study 
consisting of the feasibility of the development of Module-based STEM and the 
clarification of the Module effectiveness to the scientific literacy skills. 


The feasibility of The Module 

One of the famous private high schools in Sidoarjo is where the research was 
conducted, on 2020/2021 school year in the even semester. The analysis stage is 
carried out by analyzing the basic competencies of physics subjects to be integrated 
with the STEM approach. The basic competencies selected are 3.11 optical instrument 
workings analyse using light reflection and refraction properties through lenses and 
mirror and 4.11 Applying the reflection and refraction principle towards lenses and 
mirrors to create works. In the analysis of the basic competency 3.11 and 4.11, then it 
is broken down into six indicators which are then analyzed referring to the disciplines 
of technology, engineering, science, and mathematics in the learning to be designed, 
can be seen in Table 3. 
Table 3. Analysis of Competency Achievement Indicators 








Competency Achievement Indicators Disciplines 
3.11.1 Describing the components of an optical Science 
apparatus 


3.11.2 Describing the function of each component of an — Science 
optical instrument 
3.11.3 Analyzing the operation of optical instrument Science, Technology 
3.11.4 Determining the nature of the image produced by Science 
the optical instrument 
3.11.5 Determining the magnification of the image Mathematics 
produced by the optical device 
4.111 Making simple optical devices that can be used in Science, Technology, 
everyday life. Engineering, 
Mathematics. 





The developed module contains material for optical instruments, including eyes, 
cameras, loops, projectors, microscopes and telescopes. Each discussion of an optical 
instrument starts with the components of an optical instrument, the function of each 
optical instrument component, the working mechanism of the optical instrument, 
calculating the magnification of the image produced by an optical instrument. There 
is also a student worksheet about making a simple optical instrument in the developed 
module, namely a smartphone projector from cardboard. Each section on the student 
worksheet contains the STEM approach integration, they are the disciplines of 
technology, engineering, science, and mathematics. The STEM attribute in the module 
shows in Table 4. The students’ scientific literacy skills who gained STEM learning 
will automatically increase because they will be more literate in STEM aspects 
(Khaeroningtyas et al., 2016). 
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Table 4. The Example of STEM Attribute in the Module 
Science Technology Engineering Mathematics 


























Gambar 8. Bagian-bagian Proyektor 








After the Module-based STEM with Optical Instrument has been developed, an 
expert validation test is conducted. The aspects assessed in the expert validation test 
step are the material's content, language, and appearance —The results of validation 











are displayed in Table 5. 

Table 5. Validation Result of The Module-based STEM 
No Aspects Score Category 
1 Material Content 4.35 Good/ Valid 
2 Language 4.00 Good / Valid 
3 Appearance 4.50 Good / Valid 
Average 4.28 Good / Valid 





There are three aspects based on Table 5 validation results, namely substantial 
content, language, and appearance which got scores respectively 4.35; 4.00; 4.50. The 
average validation score is 4.28. So it can be stated that the Module-based STEM that 
has been validated is categorized as valid or suitable to be implemented in online 
learning. The aspects assessed in the feasibility component of material content are 
material coverage, material accuracy, up-to-date, stimulating curiosity, and 
developing scientific literacy skills. These aspects lead to how the module presents 
concepts scientifically, has novelty, and trains scientific literacy skills. According to 
Puspitasari et al. (2019), teaching materials should have the following characteristics: 
(1) presenting factual, conceptual, and procedural learning materials; (2) integrated; 
(3) student-centered; and (3) oriented to scientific literacy. Students' scientific literacy 
is significantly improved at each domain through the quality science textbooks 
implementation in teaching and learning activities. (Sinaga et al., 2017) 

The second component of feasibility was language in terms of accuracy in the 
use of language and according to the General Guidelines for Indonesian Spelling. 
Based on the score obtained on the language aspect, it is known that the Module-based 
STEM has used the correct Indonesian language rules. According to Panjaitan et al., 
(2021), the accuracy of language in the textbook is ensured that double interpretation 
will not be occurred, and the information can be learned and understood by the 
readers. Sinaga et al., (2017) also stated that textbooks with high readability would 
facilitate students processing and understanding the textbooks’ information or the 
content easily. When students can easily understand the information in the module, it 
will accommodate students to learn about scientific literacy skills. 
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The last component of feasibility was the appearance of the module. In this 
component, there are three indicators, namely cover design, systematic arrangement 
of modules, as well as clarity of display of images and tables. The first indicator is the 
presentation of the cover design. The cover design of this module is adjusted to the 
combination of colors, images, shapes, and sizes of letters that match to describe the 
contents of the module. Muswita et al., (2020) stated that the harmonious combination 
of colors, letters, and cover images can provide an overview of the content so that it 
can attract readers' interest. The second indicator is a systematic arrangement of 
module. This module was arranged sequentially from the cover, list contents, pictures, 
information about optical instruments, student worksheets integrated STEM and 
references. The sequence arrangement of the module components aims to build the 
readers' thinking power easier while reading the module. In line with Rizawayani et 
al., (2017) When read an object, the readers’ thinking power in receiving the 
information or knowledge will be built by applying the systematic presentation. The 
last indicator is the clarity of the images and tables display. The display of pictures 
and tables has to be understandable so that learning is carried effectively (Paramita et 
al., 2018). 

Modules that have been validated are still being corrected based on the expert’s 
suggestions, which are displayed in Table 6. 

Table 6. Suggestion and Refinement 











Suggestion Refinement 

1. The image sizes of rods and cones 1. Enlarge the image size of rods and 
are too small. cones in the eye. 

2. The image forming the image on 2. Clarify the image formation of the 
the reflecting telescope is less clear. image on the reflecting telescope. 

3. The image of the image formation 3. Clarify the image formation of the 
on the loop is less clear. image on the loop. 

4. The projector image is not big 4. Enlarges the projector image size 
enough 5. Changing the word "under a 

5. The choice of the word "under a microscope" to "using a microscope". 


microscope" is replaced by "using 
a microscope". 





Student’s Scientific Literacy 
An n-gain score analysis is performed to determine the effect of Module-based 

STEM on Students' Scientific Literacy. Before the N-gain test, the data obtained were 
tested whether the data was distributed normally. In accordance to the Kolmogorov- 
Smirnov test, the significance value result was 0.218 greater than 0.05. In other words, 
the data were normally distributed. Therefore, this research used N-Gain to measure 
the improvement of students’ skill on scientific literacy. The pre-test and post-test 
scores of students on scientific literacy skills are revealed in Table 6. 
Table 6. The average pre-test, post-test, and N-gain scores 

N Pre-Test Post-Test N-Gain Category 

30 44.81 76.30 0.5 Medium 
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The results of the scientific literacy test illustrate the extent to which students 
master the optical instrument material. Regarding the pre-test and post-test results 
revealed in Table 6, it can be seen that the Module-based STEM has a moderate effect 
in helping students master scientific literacy skills. 

This study measured some scientific literacy indicators, namely scientific 
reasoning, scientific investigation, and problem-solving. On Table 5, the students' pre- 
test scores can be known that the three classes’ score were low. In other words, before 
the learning implementation with the STEM approach, students' scientific literacy 
skills were in a low category. Students are less able to explain scientifically a 
phenomenon related to optical devices, solve problems about the implementation of 
optical devices in everyday life, and identify problems and variables that will be 
studied in an experiment. 

In contrast to the pre-test results, the mean scores of post-test scientific literacy 
in both the experimental and the replication clasand replication classes 1 and 2 
describe that the students' skills in scientific literacy are decent. Students are capable 
to define the exact solution of a given optical instrument problem, provide reasons in 
accordance with scientific concepts and determine research problems and variables in 
an experiment to find the magnification of optical instruments. This proves that the 
module-based STEM implemented in e-learning, can help students master the 
concepts and skills of scientific literacy in the material of optical instruments. 


ukuran jarak smartphone ke lensa (lup). 





WP 
* 





4. Langkah-iangkan Mem Smartphone dari Kardus 
Berdasarkan desain yang kalian rencanakan pada no.3, silahkan kalian tulis 
iangkah-langkah daiam membuat "Proyekior Smartphone dari Kardus” kalian pada kolak 


Figure 1. Designing the Projector from Cupboard 


Module-based STEM, which is implemented in e-learning, plays a crucial part in 
training students' scientific literacy skills. Apart from the module providing scientific 
concepts about optical instruments, the module also facilitates students to practice 
being engineers. Students are asked to design a simple projector from cardboard based 
on a smartphone (Figure 1). Based on the designs that have been made, students are 
then asked to make the product and test it whether the projector product can function 
properly. In other words, the projector is said to be working if it is capable of 
producing a clear and enlarged image. Students are trained to have problem problem- 
solving abilities at this stage because when the projectors that are made are not able 
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to produce a clear image, students will try to find alternative solutions so that the 
projectors that are made work well. After the projector is able to produce a clear and 
enlarged image, students are required to calculate the magnification produced by the 
projector and determine the focus size of the convex lens used. Listiana et al., (2019) 
explained that The STEM learning approach could facilitate students to develop their 
scientific literacy skills because the engineering techniques design procedure 
knowledge is given to the students. Afriana et al., (2016) also revealed that in the Pj/BL 
STEM learning, students were directed to design and make the project, use material 
and tools, arrange solutions, and calculate the results mathematically, influencing 
students scientifically literacy skills. In STEM Education, the student will be capable 
to literate scientifically and carried out the problem-solving procedures when the 
student has high problem-solving skills and affects the student’s scientific literacy 
(Yuliati et al., 2018). Meanwhile, Idawati et al., (2019) explained that Learning through 
an inquiry-based authentic learning approach in the STEM program holds higher 
literacy skills to students who have low problem-solving abilities than the student 
using the conventional learning concept. 


CONCLUSION 

The research results discussion concludes the validity and feasibility of the 
STEM-based module on optical instrument material used in distance learning (e- 
learning) are declared by the experts. Moreover, the implementation of STEM-based 
modules on optical instrument material through e-learning on students' scientific 
literacy skills has a moderate effect. 


RECOMMENDATION 

In further research, the development of STEM-based science teaching materials 
is needed in other materials. The STEM approach is considered very suitable for both 
online and offline learning. Moreover, one of the main obstacles to implementing 
STEM in distance learning is that some students do not work on projects due to a lack 
of motivation. Therefore, to overcome the weaknesses in distance learning (e- 
learning), teachers' motivation is also necessary to ensure that students participate 
actively in learning. 
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